AD-A193  613 
UNCLASSIFIED 


STRONG  LAN  FOR  NIXING  SEOUENCE(U)  PITTSBURGH  UNIV  PA  1/1 
CENTER  FOR  HULTIVARIATE  ANALVSIS  X  CHEN  ET  AL.  DEC  87 
TR-84-47  AFOSR-TR-88-8481  F49628-83-C-8888 

F/G  12/3  NL 


MICROCOPY  RESOLUTION  TEST  CHART 

•  JRF  AU  i,*  ^T*NnAROS-l%3-A 


AD-A193  615 


K.VJW 


it.  wo  vcwcfbg  uu  it:  nswi  wvrav  wisuk.hu  vuvueuv 

(ffltJlLLXGEJ 


AFOS^  m.  8  8-  0401 


STRONG  LAW  FOR  MIXING  SEQUENCE* 


Xiru  Chen  and  Yuehua  Wu 


Center  for  Multivariate  Analysis 
University  of  Pittsburgh 

►  i 

|  Technical  Report  No.  87-47 


k 


Center  for  Multivariate  Analysis 
University  of  Pittsburgh 


DTIC 


ECTE 


MAY  0  3 1988 


DISTRIBUTION  STATEMENT  A 


Approved  far  public 
Distribution  Unlimited 


gg  iT  28*/- 


Unclassified _ _  ^ 

SiCUWly  UkSVIMI  A  1 1ON  ul  tMI>  PAOL  (Whmn  Umlm  k.nloreU) _ _ 

|  REPORT  DOCUMENTATION  PAGE  [  n^tV^LS'g' raw. 

|l  REPORT  NUMBER  .  |2  GOVT  ACCESSION  NO.  »•  RECIPIENT'S  CATALOG  NUMBER 

t,f*‘  .«  8-0401  fi  |  a 


«.  TITLE  (anil  SnAUUa) 


Strong  law  for  mixing -sequence 


»  tyfi  of  rcaokt  «  pinioo  covemco 

JOutfl*.  / 

T«>pteel  -  December  1987 


i».  authoai.j 


Xiru  Chen  and  Yuehua  Wu 


•  PCKFO*HIHO  OHO.  REPORT  NUMBER 

87-47 

•  contract  on  grant  numberi.) 

F49620-85-C-0008 


10.  PROGRAM  ELEMENT.  PROJECT.  TASK 
AREA  A  WORK  UNIT  NUMBERS 


•  ■  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

Center  for  Multivariate  Analysis 

Fifth  floor  Thackeray  Hall 

University  of  Pittsburgh,  Pittsburgh,  PA  15260 


II.  controlling  office  name  and  address 

Air  Force  Office  of  Scientific  Research 
Department  of  the  Air  Force 
Bollinq  Air  Force  Base,  DC  20332 


M.  MONITORING  AGENCY  name  *  ADORESSfff  dlltoronl  Irom  Controlling  OlOco)  li.  SECURITY  CLASS.  (•!  Ihf  rppofi) 

(Y^  Unclassified 

-^PvP^-DC  30333 


IS.  DlSTHlWUTlON  STATEMENT  (o!  (Ala  ItaporlJ 


AREA  A  WORK 

WW  F 
.■s&HiHf 


IS.  number  of  pages 

13 


ISa.  oecl  assification/ downgrading 
schedule 


Approved  for  public  release;  distribution  unlimited. 


17.  DISTRIBUTION  STATEMENT  (of  IA«  Mafiacf  on  f  rod  In  Block  20,  U  dll  front  from  Moport) 


•I  KEY  WORDS  (CanlMu*  on  »ldo  It  oocoooory  end  Identity  by  block  number) 

mixing  coefficient;  stationary  sequence;  strong  law  of  large  numbers. 


x  ----- 


10  ABS1  RACT  (CmIihm  an  ravaraa  aid#  II  MCMI«r  and  idanl Ilf  by  block  number) 


In  this  note  we-gresent  some  theorems  on  the  strong  law  for  the  mixing 
sequence  which  is  not  necessarily  stationary,  and  the  mixing  coefficient 
involving  only  a  pair  of  variables  in  the  sequence.  V,.  ,  r 


00  .'ST*  1473 


Unclassified 

SECURITY  CLASSIFICATION  OF  THIS  PAGE  flWian  Data  Eniaratlj 


W5 


STRONG  LAW  FOR  MIXING  SEQUENCE* 


Xiru  Chen  and  Yuehua  Wu 

Center  for  Multivariate  Analysis 
University  of  Pittsburgh 

Technical  Report  No.  87-47 


December  1987 


Center  for  Multivariate  Analysis 
Fifth  Floor  Thackeray  Hall 
University  of  Pittsburgh 
Pittsburgh,  PA  15260 


Research  sponsored  by  the  Air  Force  Office  of  Scientific  Research  under 
Contract  F49620-85-C-0008.  The  United  States  Government  is  authorized 
to  reproduce  and  distribute  reprints  for  governmental  purposes  notwith¬ 
standing  any  copyright  notation  hereon. 


WSTREBUTiON  8TATEtvtENf 


Approved  for  public 
Distribution  Uaiii-.iiwi 


n 


>  i.»  1*1  #_§  (.§'  #.| 


STRONG  LAW  FOR  MIXING  SEQUENCE  * 


Xiru  Chen  and  Yuehua  Wu 


ABSTRACT 

In  this  note  we  present  some  theorems  on  the  strong  law  for  the  mixing 
sequence  which  is  not  necessarily  stationary,  and  the  mixing  coefficient 
involving  only  a  pair  of  variables  in  the  sequence. 


AMS  1980  Subject  Classifications:  Primary  60F15. 


Key  words  and  phrases:  mixing  coefficient,  stationary 
of  large  numbers. 


sequence,  strong  law 


Research  sponsored  by  the  Air  Force  Office  of  Scientific  Research  under 
Contract  F49620-85-C-0008.  The  United  States  Government  is  authorized 
to  reproduce  and  distribute  reprints  for  governmental  purposes  notwith¬ 
standing  any  copyright  notation  hereon. 


iT 

w 

»» 

I* 


3 

S 


2 

ft 

;s 

4 

re 

i» 


i 


? 

ft 

ft 

ft 

eft 

1 


K 


ft 

& 
s 
8 

■ 

1 

m 


1 


1.  INTRODUCTION 

In  this  article  we  present  some  results  concerning  the  strong  law 
of  a  mixing  sequence  (Xn,  n  ^  1).  We  do  not  assume  that  { Xn }  is  stationary, 
and  we  use  mixing  coefficients  involving  only  a  pair  of  variables  X,  Y  (in 
that  order):  The  Rosenblatt  mixing  coefficient 

a(X,Y)  =  sup{  |P(X  e  A,  YeB)  -  P(X  e  A)P(Y  e  B)  | :  A  e  B' ,  BeB'} 
and  the  Ibragimov  mixing  coefficient 

6(X,Y)  =  sup{  |P(Y  e  B  |X  e  A)  -  P(Y  e  B)  | :  A  e  B' ,  BeB',  P(XeA)>0} 
where  B'  is  the  a-field  of  all  Bore!  sets  in  R'. 

THEOREM  1.  Suppose  that  {Xn>  n^l)  is  a  sequence  of  random  variables, 
and  for  some  p  >  1  the  following  conditions  are  satisfied: 

i°.  sup  E | X  | p  <  ».  (1) 

n  n 

2°.  There  exists  e  >  0  such  that  as  |i  -  j|  -*•  ®, 


a(X.,Xj)  <  p ( | i  -  j | )  = 


0(|i  -  j|-p/(2p-2)-e),  1  <  p  <  2, 

0(|i -j|'2/p'e),  P>2. 


(2) 


Then 


lim(S  -  ES  )/n  =0,  a.s. 

n-K»  "  n 


(3) 


Here  and  in  the  sequel  Sp  =  ][!?_.] X.. . 

THEOREM  2.  Suppose  that  {Xn>  n^l}  is  a  sequence  of  random  variables,  >r 
and  one  of  the  following  conditions  are  satisfied: 

2 


□ 

□ 


and 


(I)  l  var(X  )/n  <  »,  sup  E | X  |  <  -  , 
n=l  n  n  n 

6(X.,X.)  <  p(  |  i  "  j  | ) ,  I  J/2(n)  < 

1  J  "  n=0 


(4) 


/ 

y  Codoa 


3l 


toft* 


Avail  antl/or 
Special 
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(II)  sup  var(X  )  <  «  and  there  exists  e  >  0  such  that 
n  n 

I  p1/2(1)  =  o(n/(log  n)1+e);  (5) 

(III)  (4)  holds,  X.| ,  Xg,  ...  are  identically  distributed  and  E|X^|  <  ® 
(the  existence  of  variance  is  not  assumed).  Then  (3)  is  true. 

Remarks : 

1.  Part  (I)  of  Theorem  2  can  be  compared  with  a  result  of  Blum  et  at 
[1],  who  assumes  that  {Xn>  is  a  *-mixing  sequence  instead  of  (4).  Note  that 
this  assumption  does  not  follow  from  (4).  We  can  easily  construct  a  pair¬ 
wise  independent  sequence  which  is  not  *-mixing. 

2.  Parts  (I)  and  (II)  of  Theorem  2  can  also  be  compared  with  some 
results  (see  Theorem  3.7.2  and  Theorem  3.7.4  of  Stout  [5])  derived  from 
Serfling  [4].  The  conditions  of  these  results  involve  correlation  coeffi¬ 
cients  between  two  variables  in  the  sequence. 

3.  Part  (III)  of  Theorem  2  extends  Theorem  1  of  Etemadi  [2],  The 
assumption  that  {Xi }  is  identically  distributed  can  be  somewhat  relaxed, 
for  example,  it  can  be  replaced  by  the  condition  that  there  exists  a  random 
variable  Y  such  that  P(|Xn|^x)  £  P(  |Y|  >_x)  for  all  n  >_  1  and  x  ^  0.  We 
also  mention  a  related  result  of  Blum  et  al  [1]  Theorem  1.  They  assume 
that  { Xn }  is  identically  distributed,  the  distribution  of  X-j  has  a  moment 
generating  function  in  the  neighborhood  of  zero  and  that  { Xn }  is  *-mixing. 
Under  these  more  stronger  conditions  they  prove  that  P( }Sn  -  ESnJ/n  >_e)  tends 
to  zero  exponentially. 
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2.  PROOF  OF  THE  THEOREMS 

In  deducing  our  results  we  shall  borrow  a  trick  from  Etemadi  [2]. 

The  following  well-known  facts  concerning  a(X,Y)  and  g(X,Y)  will  be  used: 

|cov(X,Y)|  <  10(a(X,Y))6/(2+<S)(E|X|2+6E|Y|2+6)1/{2+6),  6>0  (6) 

|cov(X,Y) |  <  2(e(X,Y)var(X)var(Y))1/2.  (7) 

For  a  proof,  see  Ibragimov  and  Linnik  [3].  Also  it  is  trivially  true  that 
a(xic(X),  YId(Y))  <  a(X,Y),  e(xic(X) ,  YIQ(Y))  <  B(X,Y)  (8) 


a(X-a,  Y-b)  =  a(X,Y) ,  B(X-a,  Y-b)  =  B(X,Y)  ,  (9) 

where  C  and  D  are  Borel  sets  in  R'  and  a,  b  are  constants. 

Proof  of  Theorem  1.  In  view  of  (9),  by  defining  X+  =  XnI(Xn>0), 

Xn  3  "Xn^n ’  n  1  1  *  we  can  assume  without  ’oss  of  generality  that  X  >_  0, 


n  >  I .  Define 


v„=  (X„-EX„)I(|Xn-EXnl  <n 

S"'  j/V'V- 


1/p+e, 


),  n  >  1, 


(10) 


where  e-j  >  0  is  a  constant  to  be  chosen  later. 

From  condition  (1)  we  have  5!“=^P(Xn  -  EXp  ^  Yp)  <  °°  and  lim  EYn  =  0. 
Therefore,  (3)  is  equivalent  to 

lim  S*/n  =0,  a.s. 

n-**>  n 


(ID 


Now  fix  a  >  1  and  let  kn  =  [o11].  For  positive  integer  m  sufficiently  large, 
there  exists  n  such  that  kn  <_  m  <  kp+^ ,  and  n  -*■  »  as  m  -*•  ®.  From  (1)  we  have 
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sup  E | Y  |  =  C  <  ».  ( 

n  n 

Here  and  in  the  sequel  C  is  an  unimportant  constant  which  is  allowed  to 
change.  Since  Yn  >_  0,  it  follows  that 

S*-S*  >-(m-kn)C,  when  S*  <  S* 
n  n 

Sm  ‘  Sk  -  Sk  ,  '  Sk  +  (kn+l  ■m)C*  when  Sm  -  Sk  * 
n  n+ I  n  n 


Hence 


S*  S* 

k  °k  k  - k 

,,  ,  .  n+l  n+l  Kn  .  Kn+1  Kn  r 

lym  -  s  /kj  <  n—  -r—  -  x-  *  — r — c- 

n  n  n+l  n  n 


From  (13)  it  follows  that  if  we  have  shown  that 


lim  S.  /k  =  0,  a.s. 

n-*x>  Kn  n 


Then  we  would  have 


lim  sup|S  /m|  <_  (o  -  1)C,  a.s. 


For  any  a  >  1,  hence  (11). 

By  Borel-Cantelli  lemma,  in  order  to  prove  (14),  we  have  only  to  show 

that 

l  var(S*  )/kjj  <  «.  (15] 

n=l  n 

By  (6),  (8)  and  (9),  we  have  for  any  6  >  0: 
kn 

Var(S*  )  =  l  cov(Y.,Y.) 
kn  k,j=l  J 

<C  kf  («<X,. Xi))5/(2+5>(E|Y1|2+SE(Yi|2+4)1/(2+{).  (16: 

i  ,j=l  1  J  J 


i 


w-_  S 


*r*  *v  «Tw  r.  «rv  *■ 


iWi'?  I 
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From  (1)  it  follows  that 


.  ,2+6  (2+6-p)(l/p+e. ) 

ElYnl  -  Cn  .  n  =  1,2 . 


First  consider  the  case  p  >  2.  From  (2),  (16)  and  (17)  we  obtain 


var(S*)<C  l  (a(X.,X.))6/(2+6)(ij) 
kn  i,j=r  1  J 

«c  z  («(x1,x1))s''<z^’12<2 

i,j=l  1  J 


(2+6-p) (1/p+e, )/(2+6) 


2(2+6-p)(l/  p+e  -j)/(2+6) 


<c  .-(2/p+e)6/(2+6)  .2(2+6"p)(1/p+el)/(2+6)  {18) 

i,j=l  i=l 

Noticing  2/p  <  1 ,  we  can  assume  that  2/p  +  e  <  1.  Hence  from  (18)  we  have 

*  —  ( 2/ p+e )  6/ ( 2+6 )  +  2  ( 2+6-p)  ( 1  /  p+e  ■» )  /  ( 2+6 )  +  2 

var(S.  )  <  Ck  '  (19) 

n  " 

This  inequality  holds  for  any  6  >  0.  Now  we  choose  e  (0,e/2),  then 

lim{-(2/p  +  e)6/(2+fi)  +  2( 2+6-p) ( 1  /p  +  e ■, ) / ( 2+6 ) }  =  -e  +  2e-i  h  n  <  0. 

6-x“  1  1 

Therefore,  choosing  6  sufficiently  large,  from  (19)  we  obtain 

var(Sk  )  <_  Ck2-T1.  Hence  (15)  is  true  in  view  of  £”_ik"n  < 
n 

Next  assume  that  p  =  2.  Again,  choose  e  (0,e/2).  Choose  6  >  0 
sufficiently  small,  such  that  (l+e)6/(2+s)  <1.  We  still  have  (19),  with 
p  =  2.  Since 

- ( 1  +e ) 6/ ( 2+6 )  +  26(l/2  +  e1)/(2+6)  =  -(e  -  Zt^  )6/(2+6)  <  0, 

(15)  holds  again. 

Finally,  consider  the  case  1  <  p  <  2.  In  this  case  we  have,  instead 
of  (18), 


.V'X/XV 


Part  (II)  is  proved  in  much  the  same  way  as  Part  (I),  only  that  we 
k  k 

replace  Ckn  for  J^varfX.)  and  Ckp/(log  n)1+E  for  ^^u1//2(i )  in  (21)  to 
obtain  (22).  Part  (III)  is  proved  by  truncating  Xn  at  n  and  combining  the 
reasoning  above  and  that  of  Etemadi  [2]. 

3.  AN  EXAMPLE 

Consider  the  autoregression  model 

Xn  =  alXn-1  +  +  amXn-m  +  en’  n  =  •  (23 

We  want  to  show  that  under  certain  conditions  it  is  true  that 

n 

lim  l  X./n  =  0,  a.s.  (24 

n-*»  i=i  1 

for  any  solution  of  (23).  Suppose  that  the  following  conditions  are 
satisfied: 

1.  (en,  n  =  0,±1,...}  is  a  sequence  of  independent  real  random  vari¬ 
ables,  and 

Ee  =  0,  n  =  0,±1,...,  sup  E|e  I*3  =  C  <  °°  for  some  p  >  I.  (2b) 

n  -oo<n<co  " 

where,  as  before,  C  is  an  unimportant  constant  which  is  allowed  to  change. 

2.  en  has  a  density  f  satisfying  the  Lipschitz  condition  over  R ’ : 

|fn(x)  -  fn(y)  |  <_  Cjx  -  y| ,  n  =  0,±1  ,±2,. . .  (26) 

where  C  does  not  depend  on  n. 

3.  a2»  ...»  am  are  real  constants,  and  the  equation  1  -  a^z  -  ... 

a  zm  =  0  has  all  its  root  outside  the  unit  circle, 
m 

Under  the  condition  1  and  3,  the  general  real  solution  of  (23)  has 
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the  form 


V 


n  =  J/tVt  *  J.^3  n“j  +  ysin  n“j>  5 


x  +  X* 
n  n 


(27) 


where  b^  =  1 ,  b£,  bg,  ...  are  real  constants  such  that 


|btl  1  CHt ,  t  =  0,1,2,...  for  some  H  e  (0,1 ) . 


(28) 


p.  and  u).,  j  -  1,...,J,  are  real  constants,  0  <  p.  <  1,  j  =  1,,..,J, 
J  J  J 


m 


^  +  . . .  +  nij  =  m,  and  c  t,  n  t,  i  =  1 , . . .  ,m ^ ,  j  =  1,...,J,  are  arbitrary 
random  variables.  From  (25),  (27)  and  (28)  it  follows  that 


EX  =0,  n  =  0,  1,  2,...,  sup  E | X  | p  =  C  < 

n  -tt><n<co  n 


(29) 


Let  n,  N  be  positive  integers,  n  <  N.  Define 

N-n-1 


'nN 


t=o  ZpN  =  t^-n^'1' 


Since  b^  =  1 ,  from  (26)  it  follows  that  the  density  gnN  of  YnN  obeys  Lipschitz's 
condition  with  the  same  constant  C  as  in  (26).  Also 


sup{E|  Yn^|P:  1  <^n  <  N  <  “}  =  C  <  «°. 


(30) 


Now  let  be  a  positive  constant,  qg  =  2q^.  Define  the  event 


-q, 


°nN'  (|ZnNl  >  (N-n)  ‘J. 


(31) 


(25)  entails  sup  E|e  |  =  C  <  ®.  Hence 


-00<f|«» 


P(D_J  1  C(N-n)q2  l  Ht  <  C(N-n)q2HN"n. 
n"  t=N-n 


(32) 


Let  G  be  a  Bore!  set  in  R',  h  be  a  constant.  G  -  h  is  defined  as  the 


~  P-i 

set  {g-h:  geH}.  Write  G  =  Gfl{u:  ju [  <.(N-n)  G*  =  G\G.  If  |h|  <  1, 
we  have 

lP(YnNeG)-p(YnNeG-h^ 

-  |P(YnN  6  G)  ‘  P(YnN  6  G  "  h)  1  +  P(YnN  6  G*}  +  P(YnN  6  G*  *  h) 

-  jglgnN(u)'gnN(u*h)ldu  +  P(lYnNl  "  (N- n)^) +  P(|YnN|  '  (N-n)^  -T 

Pi  “Pi  Pi  i 

<  C(N-n)  'h  +  C(N-n)  1  +  C[(N-n)  1  -1]  1 

Pi  “Pi 

<  C(N-n)  'h  +  C(N-n)  \  (33) 


Now  let  A  and  B  be  two  Borel  sets  in  R‘.  We  proceed  to  estimate 
|P(XneA,  X^  e  B)  -  P(Xn  e  A)P(XN  e  B)  | .  From  (32),  (33)  and  the  independence 


of  e1 ,  e2,  • ...  we  have 


'P^neB(en’en-r---^P^nNeB^  *  lP^nN  e  B  ‘  ZnNlZnN^  P^nN  e  B> 


<  C(N-n) 


-(Po-Pi)  -q 

£  I  .  nfii  _\ 


+  C(N-n) 


“Pi 

<  C(N-n) 


(34) 


when  does  not  occur.  But 


lP<VB)-P(Y„N«B)|  =  !P(YnNeB-ZnN) -P<YnNeB)t 

*  lP(0nN>P<y,,N  6  6  '  V  *  P<‘WP(VnN  e  6  '  Z  JDnN> 
-  P<Y„N  6  B>  I 


iP(DnN>  +  iP^YnNeB-ZnNlW“P(YnNeB)l  +P<°nN) 

<  2P(DnN)  +  C(N-n)  Ql  <  C(N-n)^ZHN-n  +  C(N-n)  ^ 

-Pi 

<  C(N-n)  (35) 
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From  (34)  and  (35)  we  get 

(p(XN  e  B jen,en_i ,. . .)  -  P(XN  e  B) |  <  C(N-n)  ^ 

-q, 

when  0nN  does  not  occur.  If  P(XneB)  >  C(N-n)  then  from  (33)  and  (35) 
we  obtain 

P(*neA’  *NeB)  1  Cp(XN  e  B)  -  C(N-n)  ^  ][P(Xn  e  A)  -  C(N-n)%N'n] .  (36) 

Also 

p(XneA,  XNeB)  <  [P(XNeB) +  C(N-n)  q]][P(Xn  e  A)  +  C(N-n)%N'n] .  (37) 

From  (36)  and  (37)  we  have 

|P(XneA,  XNeB)-P(XneA)P(XNeB)|  <  C(N-n)’qi  +  0^)%"'" 

+C(N-n)qiHN‘n  <  C(N-n)  ^ ,  (38) 

“Pi 

where  C  does  not  depend  on  A.  B.  (38)  is  proved  when  P(X  eB)  >  C(N-n)  . 

"ql  n 

If  P(XNeB)  <  C(N-n)  ,  (38)  is  trivially  true.  Therefore  we  get 

«(Xn,XN)  <  C(N-n)  qi.  (39) 

Now  choose  q^  =  p/(2p-2)  +  2.  From  (39)  we  see  that  the  condition  (2)  is 
satisfied.  This,  together  with  (29),  gives,  by  Theorem  1, 

n 

lim  l  X./n  =  0,  a.s.  (40) 

rn«  i  =  i 

From  the  expression  of  X*,  it  is  readily  seen  that 

n  * 

lim  l  X./n  -  0,  a.s.  (41) 

n-H»  i  =  ]  1 

From  (27),  (40)  and  (41),  we  obtain  (24). 
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The  conclusion  (40)  does  not  follow  from  the  ergodic  theorem  of  station¬ 
ary  process,  since  { en }  is  not  assumed  to  be  identically  distributed,  so 
{Xn>  may  not  be  a  strictly  stationary  process. 


REFERENCES 

[1]  BLUM,  J.R. ,  HANSON,  D.L.  and  K00PMANS,  L.H.  (1963.  On  the  strong  law 
of  large  numbers  for  a  class  of  stochastic  process,  z.  Wahrschein- 
lichkeitstheorie  und  Verm.  Gebiete  2,  1-11. 

[2]  ETEMADI,  N.  (1981).  An  elementary  proof  of  strong  law  of  large 
numbers.  Z.  Wahrscheinlichkeitstheorie  und  Verm.  Gebiete  55,  119-122. 

[3]  IBRAGIMOV,  I. A.  and  LINNIK,  J.V.  (1965).  Independent  and  Stationary 
Connected  Variables  (Nauka,  Moscow),  English  translation  (Noordhoff, 
Groningen,  1971). 

[4]  SERFLING,  R.J.  (1970).  Convergence  properties  of  S  under  moment  re¬ 
strictions.  Ann.  Math.  Statist.  41,  1235-1248.  n 

[5]  STOUT,  W.F.  (1974).  Almost  Sure  Convergence.  Academic  Press. 


tfWHVWVjr 


-■  «*  /•/. A/.V.V. 


